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Abstract 

In this paper, we investigate the deductive inference for the interiors and 
exteriors of Horn knowledge bases, where the interiors and exteriors were in- 
troduced by Makino and Ibaraki [11] to study stability properties of knowledge 
bases. We present a linear time algorithm for the deduction for the interiors 
and show that it is co-NP-complete for the deduction for the exteriors. Under 
model-based representation, we show that the deduction problem for interiors 
is NP-complete while the one for exteriors is co-NP-complete. As for Horn en- 
velopes of the exteriors, we show that it is linearly solvable under model-based 
representation, while it is co-NP-complete under formula-based representation. 
We also discuss the polynomially solvable cases for all the intractable problems. 

1 Introduction 

Knowledge-based systems are commonly used to store the sentences as our knowl- 
edge for the purpose of having automated reasoning such as deduction applied to 
them (see e.g., [1]). Deductive inference is a fundamental mode of reasoning, and 
usually abstracted as fohows: Given the knowledge base KB, assumed to capture 
our knowledge about the domain in question, and a query x that is assumed to 
capture the situation at hand, decide whether KB implies denoted by KB \= x, 



*An extended abstract of this article was presented in Proceedings of Algorithms and Computa- 
tion, 19th International Symposium (ISAAC 2008), Lecture Notes in Computer Science, Vol. 5369, 
pp. 390-401, Springer- Verlag Berlin Heidelberg, 2008. 
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which can be understood as the question: "Is x consistent with the current state 
of knowledge ?" 

In this paper, we consider tlic interiors and exteriors of knowledge base. For- 
mally, for a given positive integer a, the a-interior of KB, denoted by a-a{KB), 
is a knowledge that consists of the models (or assignments) v satisfying that the 
a-neighbors of v arc all models of KB, and the a-exterior of KB, denoted by 
(Ja{KB), is a knowledge that consists of the models v satisfying that at least one 
of the a-neighbors of f is a model of KB [11]. Intuitively, the interior consists of 
the models v that strongly satisfy KB, since all neighbors of v are models of KB, 
while the exterior consists of the models v that weakly satisfy KB, since at least 
one of the a-neighbors of f is a model of KB. Here we note that v might not satisfy 
KB, even if we say that it weakly satisfies KB. As mentioned in [11], the interiors 
and exteriors of knowledge base merit study in their own right, since they shed 
light on the structure of knowledge base. Moreover, let us consider the situation in 
which knowledge base KB is not perfect in the sense that some sentences in KB 
are wrong and/or some are missing in KB (see also [11]). 

Suppose that we use KB as a knowledge base for automated reasoning, say, 
deductive inference KB \= x- Since KB does not represent real knowledge KB* , 
the reasoning result is no longer true. However, if we use the interior a-aiKB) of 
KB as a knowledge base and have a-a{KB) ^ X) then we can expect that the 
result is true for real knowledge KB*, since a-a{KB) consists of models which 
strongly satisfy KB. On the other hand, if we use the exterior aa{KB) of KB 
as a knowledge base and have aa{KB) \= x, then we can expect that the result is 
true for real knowledge KB* , since aa{KB) consists of models which weakly satisfy 
KB. In this sense, the interiors and exteriors help to have safe reasoning. 

Main problems considered. In this paper, we study the deductive inference for 
the interiors and exteriors of propositional Horn theories, where Horn theories are 
ubiquitous in Computer Science, cf. [13], and are of particular relevance in Artificial 
Intelligence and Databases. It is known that important reasoning problems like 
deductive inference and satisfiability checking, which are intractable for arbitrary 
propositional theories, are solvable in linear time for Horn theories (cf. [3]). 
More precisely, we address the following problems: 

• Given a Horn theory S, a clause c, and nonnegative integer a, we consider the 
problems of deciding if deductive queries hold for the a-interior and exterior of S, 
i.e., (T_a(S) 1= c and (Ta(S) \= c. It is well-known [3] that a deductive query for a 
Horn theory can be answered in linear time. Note that it is intractable to construct 
the interior and exterior for a Horn theory [11, 12], and hence a direct method (i.e., 
first construct the interior (or exterior) and then check a deductive query) is not 
possible efficiently. 
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• We contrast traditional formula-based (syntactic) with model-based (seman- 
tic) representation of Horn theories. The latter form of representation has been 
proposed as an alternative form of representing and accessing a logical knowledge 
base, cf. [2, 4, 5, 7, 8, 6, 9, 10]. In model-based reasoning, S is represented by 
a subset of its models which are commonly called characteristic models. As 
shown by Kautz et al. [7], the deductive inference can be done in polynomial time, 
given its characteristic models. 

• Finally, we consider Horn approximations for the exteriors of Horn theories. 
Note that the interiors of Horn theories are Horn, while the exteriors might not be 
Horn. We deal with the least upper bounds, called the Horn envelopes [15], for the 
exteriors of Horn theories. 

Main results. Wc investigate the problems mentioned above from an algorithmical 
viewpoint. For all the problems, we provide either polynomial time algorithms or 
proofs of the intractability; thus, our work gives a complete picture of the tractabil- 
ity /intractability frontier of deduction for interiors and exteriors of Horn theories. 
Our main results can be summarized as follows (see Figure 1). 

• We present a linear time algorithm for the deduction for the interiors of a given 

Horn theory, and show that it is co-NP-complete for the deduction for the exteriors. 
Thus, the positive result for ordinary deduction for Horn theories extends to the 
interiors, but does not to the exteriors. We also show that the deduction for the 
exteriors is possible in polynomial time, if a is bounded by a constant or if |iV(c)| 
is bounded by a logarithm of the input size, where N{c) corresponds to the set of 
negative literals in c. 

• Under model-based representation, we show that the consistency problem and 
the deduction for the interiors of Horn theories are both co-NP-complete. As for 
the exteriors, we show that the deduction is co-NP-complete. We also show that 
the deduction for the interiors is possible in polynomial time if a is bounded by a 

constant, and so is for the exteriors, if a or |P(c)| is bounded by a constant, or if 
|A^(c)| is bounded by a logarithm of the input size, where P{c) corresponds to the 
set of positive literals in c. 

• As for Horn envelopes of the exteriors of Horn theories, we show that it is lin- 
early solvable under model-based representation, while it is co-NP-complete under 
formula-based representation. The former contrasts to the negative result for the 

exteriors. Wc also present a polynomial algorithm for formula-based representa- 
tion, if a is bounded by a constant or if |iV(c)| is bounded by a logarithm of the 
input size. 
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*: It is polynomially solvable, if a = 0(1) or |Ar(c)| = 0(log || S ||). 

^: It is polynomially solvable, if a = 0(1). 

It is polynomially solvable, if a = 0(1), \P{c)\ = 0(1), or \N{c)\ = 
O {log n\ char (E)]). 

Figure 1: Complexity of the deduction for interiors and exteriors of Horn theories 



The rest of the paper is organized as follows. In the next section, we review 
the basic concepts and fix notations. Sections 3 and 4 investigate the deductive 
inference for the interiors and exteriors of Horn theories. Section 5 considers the 
deductive inference for the envelopes of the exteriors of Horn theories. 

2 Preliminaries 
Horn Theories 

We assume a standard propositional language with atoms At = {xi,X2, ■ ■ ■ ,Xn}, 
where each Xi takes either value 1 (true) or (false). A literal is either an atom 
Xi or its negation, which we denote by Xi- The opposite of a literal i is denoted 
by J, and the opposite of a set of literals LhyL = {i\iE:L}. Furthermore, 
Lit = AtU At denotes the set of all literals. 

A clause is a disjunction c = VjGP(c) ^ ViGAf(c) ^« literals, where P{c) 
and N{c) are the sets of indices whose corresponding variables occur positively 
and negatively in c and P{c) D N{c) = 0. Dually, a term is conjunction t = 
AieP(t) ^ AieN{t) ^» hterals, where P{t) and N{t) are similarly defined. We 
also view clauses and terms as sets of literals. A conjunctive normal form (CNF) 
is a conjunction of clauses. A clause c is Horn, if |-P(c)| < 1. A theory T, is any set 
of formulas; it is Horn, if it is a set of Horn clauses. As usual, wc identify S with 
if = Aces write c G ip etc. It is known [3] that the deductive query for a 

Horn theory, i.e., deciding if S ^ c for a clause c is possible in linear time. 

We recall that Horn theories have a well-known semantic characterization. A 
model is a vector v £ {0, 1}", whose i-th. component is denoted by Vi. For a model 
V, let ON{v) = {i \ Vi = 1} and OFF{v) = {i\vi = 0}. The value of a formula ip 
on a model v, denoted 97(f), is inductively defined as usual; satisfaction of (p in v. 
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i.e., ip{v) = 1, will be denoted by v \= cp. The set of models of a formula ip (resp., 
theory S), denoted by mod[ip) (resp., mo(i(S)), and logical consequence (p \= ^ 
(resp., S ^ -0) ^I's defined as usual. For two models v and w, we denote hy v <w 
the usual componentwise ordering, i.e., Vi < Wi for all i = 1, 2, . . . , n, where < 1; 
V < w means v ^ w and v < w. Denote hy v /\ w componentwise AND of models 
v,w e {0,1}", and by Cl;^{M) the closure of M CI {0,1}"- under f\. Then, a 
theory S is Horn representable if and only if mod{T,) = Cl^{mod{T,)) (see [2, 9]) 
for proofs). 

Example 1. Consider Mi = {(0101), (1001), (1000)} and M2 = {(0101), (1001), 
(1000), (0001), (0000)}. Then, for v = (0101), w = (1000), we have w,v ^ Mi, 
while V /\w = (0000) ^ Mi; hence Mi is not the set of models of a Horn theory. 
On the other hand, CIa{M2) = M2, thus M2 = mod(S2) for some Horn theory 

As discussed by Kautz et al. [7] , a Horn theory E is semantically represented by 
its characteristic models, where v G mod{T,) is called characteristic (or extreme [2]), 
if w Cl/y{mod{T.) \ {v}). The set of all such models, the characteristic set ofT,, is 
denoted by c/ior(S). Note that c/tar(S) is unique. E.g., (0101) G char{'E2), while 
(0000) ^ char{Ti2); we have char{T,2) = Mi- It is known [7] that the deductive 
query for a Horn theory S from the characteristic set charijl) can be done in linear 
time, i.e., 0{n\char{Tj)\) time. 

Interior and Exterior of Theories 

For a model v G {0, 1}" and a nonnegative integer a, its a-neighborhood is defined 

by 

J\fa{v) ={we {0, 1}" III w -v\\< a}, 

where || v \\ denotes \vi\. Note that \J\fa{v)\ = ^^Lo {^) ~ 0{n°'^^). For a 

theory S and a nonnegative integer a, the a- interior and a-exterior of S, denoted 
by cr_a(S) and crQ.(S) respectively, are theories defined by 

mod{a-J^)) = {v£ {0, 1}" | Ma{v) C mod(S)} (1) 
mod{aa{^)) = {v€ {0, 1}" | Ma{v) n mod(S) / 0}. (2) 

By definition, cro(^) = cr, o'ai^) \= ^^fii^) for integers a and /3 with a < (3, and 
(Jo(Si) 1= aai^2) holds for any integer a, if two theories Ei and E2 satisfy Ei ^ E2. 

Example 2. Let us consider a Horn theory E = {xi V X3, X2 V a;3,X2 V 0:4} of 4 
variables, where moo?(E) is given by 

mod(E) = {(1111), (1011), (1010), (0111), (0011), (0010), (0001), (0000)} 
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Figure 2: A Horn theory and its interiors and exteriors 



(See Figure 2). Then we have (Jq,(S) = {0} for a < —2, {xi,X2,X3,X4^} for a = — 1, 
S for a = 0, {xi V X2 V X3 V X4} for a = 1, and for a > 2. For example, (0011) is 
the unique model of mod{a-i{T,)), since A/i(0011) C mod{T?) and Ni{v) ^ modiT,) 
holds for all the other models v. For the 1-exterior, we can see that all models v 
with (xi Vx2 Vx3 Vx4)(u) = 1 satisfy A/i(f) n mod(S) 7^ 0, and no other such model 
exists. For example, (0101) is a model of (Ti(S), since (0111) E A/i (0101) n mo(i(S). 
On the other hand, (1100) is not a model of (Ti(S), since A/i(1100) n modiTi) = 0. 
Notice that (T_i(S) is Horn, while o"i(S) is not. 

Makino and Ibaraki [11] introduced the interiors and exteriors to analyze stabil- 
ity of Boolean functions, and studied their basic properties and complexity issues 
on them (see also [12]). For example, it is known [11] that, for a theory S and 
nonnegative integers a and /3, (T_Q,(cr_/3(S)) = U-a-piJ^)-, '7a((T/3(S)) = C7a+/3(S), 
and 



(Ta((T_/3(S)) ^ 0-a-/3(S) ^ CJ„^(cra(S)). 



(3) 



For a nonnegative integer a and two theories Si and S2, we have 



cT_Q,(i;i u 1:2) = cr_Q,(i;i) u cj_Q,(i;2) 

CJa,(SiUS2) \= crQ(i;i) U crQ,(E2), 



(4) 
(5) 



where (Ta(Si U S2) 7^ cra(Si) U aa{^2) holds in general. 

As demonstrated in Example 2, it is not difficult to see that the interiors of any 
Horn theory are Horn, which is, for example, proved by (4) and Lemma 3, while 
the exteriors might be not Horn. 

3 Deductive Inference from Horn Theories 

In this section, we investigate the deductive inference for the interiors and exteriors 
of a given Horn theory. 

3.1 Interiors 

Let us first consider the deduction for the a-interiors of a Horn theory: Given a 
Horn theory E, a clause c, and a positive integer a, decide if (T_a(S) \= c holds. We 
show that the problem is solvable in linear time after showing a series of lemmas. 
The following lemma is a basic property of the interiors. 

Lemma 3. Let c be a clause. Then for a nonnegative integer a, we have o"_a(c) = 

|S|=a+l |S| = |c|-a 

For example, let us consider c = xi V X2 V X3 V X4, a = 2. Then we have 

(T_a(c) = X1X2X3 V X1X2X4 V X1X3 X4 V X2X3 X4 = {xi V X2){xi V X3)(xi V X4){x2 V 
X3)(X2 V X4)(X3 V X4). 

This lemma, together with (4), implies that for a CNF ip and a nonnegative 
integer a, we have 

"-M = A( V (A<)) = A( A (V*)). 

ceip SCc: i^S cef SCc: i^S 

\S\=a+l \S\ = \c\-a 

where we regard c as a set of literals. 

Lemma 4. Let T, be a Horn theory, and let c be a clause. For a nonnegative integer 
a, if there exists a clause d € S such that \N{d)\N(c)\ < a — 1 or (|A''(d)\A'^(c)| = a 
and P{d) C P{c)), then we have (t_q,(S) \= c. 

Proof If S has a clause d such that \N{d) \ N{c)\ < a - 1, then \{N{d) \ N{c)) U 
P{d)\ < a holds. Thus by Lemma 3, we have a-aid) \= ViGAr(c)niV(d) ^« H 
Therefore, by (4), (7_a(S) \= c holds. 

On the other hand, if E has a clause d such that \N{d) \ N[c)\ = a and 
P{d) C P(c), then by Lemma 3, we have a-a{d) \= Vi6P(c) ^i^V ieN{c)nN{d) \= ^■ 
Therefore, by (4), (7-a(S) [= c holds. □ 
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Lemma 5. Let T, be a Horn theory, and let c be a clause. For a nonnegative integer 
a, if (i) \N{d) \ N{c)\ > a holds for all d e ^ and (ii) ^ P{d) C N{c) holds for 
all d E Ti with \N(d) \ N{c)\ = a, then we have (7_a(S) ^ c. 

Proof. Let v be the unique minimal model that does not satisfy c, i.e., = 1 if 
Xi £ c and 0, otherwise. We show that v \= (T_q,(S), which implies cr_Q(S) ^ c. 

Let d be a clause in S with \N{d)\N[c)\ > a+1, and let t be a term obtained by 
conjuncting arbitrary a + 1 literals in N{d) \ N{c). Then we have t{v) = 1 and t \= 
(T_Q,((i) by Lemma 3. On the other hand, for a clause (i in S with \N{d)\N{c)\ = a, 
let t be a term obtained by conjuncting all literals in {N{d) \ N{c)) U P{d). Then 
we have |t| = a + 1 and t \= a-a{d) by Lemma 3. Moreover, it holds that t{v) = 1 
by P{d) C N{c). Therefore, by (4), we have v \= cr_a(S). □ 

By Lemmas 4 and 5, we can easily answer the deductive queries, if S satisfies 
certain conditions mentioned in them. In the remaining case, we have the following 
lemma. 

Lemma 6. For a Horn theory S that satisfies none of the conditions in Lemmas 
4 and 5, let d be a clause in E such that \N{d) \ N{c)\ = a, and P{d) = P{d) \ 
(P(c) U N{c)) = {j}. Then cr_a(S) |= c V holds. 

Proof. By Lemma 3, we have a-a{d) \= \/i^N{c)nN{d) ^ H c\/ Xj. This implies 
a_a(E) HcVa;^- by (4). □ 

From this lemma, we have only to check a deductive query (J_q,(S) |= c V Xj, 
instead of (T_q;(S) |= c. Since |c| < |c V Xj| < n, we can answer the deduction by 
checking the conditions in Lemmas 4 and 5 at most n times. 

We can see that a straightforward implementation of the algorithm requires 
0(n(||S|| +|c|)) time, where ||E|| denotes the length of S, i.e., ||S||= 
However, it is not difficult to see that we have a linear time algorithm for the 
problem, if N{d) \ N for d G S is maintained by using the proper data structure. 

Theorem 7. Given a Horn theory S, a clause c and a nonnegative integer a, a 
deductive query cr_a(S) |= c can be answered in linear time, i.e., 0(||S|| +|c|) 
time. □ 

3.2 Exteriors 

Let us next consider the deduction for the a-exteriors of a Horn theory. In contrast 
to the interior case, we have the following negative result. 

Theorem 8. Given a Horn theory S, a clause c and a positive integer a, it is co- 
NP-complete to decide whether a deductive query aaC^) \= c holds, even if P{c) = 0. 
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Algorithm 1 Deduction-Interior-from-Horn-Theory 



Input: A Horn theory S, a clause c and a nonnegative integer a. 
Output: Yes, if cr_a(S) |= c; Otherwise, No. 

Step 0. Let := N{c) and P := P{c). 

Step 1. /* Check the condition in Lemma 4. */ 

If there exists a clause d G E such that \N{d) \N\ < a - 1 or {\N{d) \ iV| = a 
and P{d) C P), then output Yes and halt. 

Step 2. /* Check the condition in Lemma 5. */ 

If P{d) C N holds for all d G S with \N{d) \ iV| = a, then output No and 
halt. 

Step 3. /* Update N by Lemma 6. */ 

For a clause d in S such that \N{d)\N\ = a and P{d) = P{d)\{P[JN) = {j}, 
update N := N U {j} and return to Step 1. □ 



Proof. By definition, a = a(S) ^ c if and only if there exists a model v of T, 
such that some model in Na{v) does not satisfy c. The latter is equivalent to the 
condition that there exists a model v oiT, such that | ON{v) H P{c) \ + | OFF{v) fl 
N{c)\ < a, which can be checked in polynomial time. Thus the problem is in co-NP. 

We then show the hardness by reducing a well-known NP-complete problem 
Independent Set to the complement of our problem. Independent Set is the 
problem of deciding if a given graph G = (V, E) has an independent set W V 
such that \W\ > A; for a given integer k. Here we call a subset C 1/ is an 
independent set of G if |VF n e| < 1 for all edges e & E. For a problem instance 
G = {V = {1,2,..., n}, E) and k of Independent Set, let us define a Horn theory 
Eg over At = {xi, X2, . . . , Xn} by 

Eg = {{xi^Xj) I G E}. 

Let c = Vr=i ^« a = n — k. Note that (11 • • • 1) is the unique model that does 
not satisfy c. Thus <Ta(S) ^ c if and only if cJa(S)(ll • • • 1) = 1. Since W is an 
independent set of G if and only if contains a model w defined by ON{w) = W, 
a"Q,(E(3)(ll • • • 1) = 1 is equivalent to the condition that G has an independent set 
of size at least k{= n — a). This completes the proof. □ 

We remark that this result can also be derived from the ones in [11]. 
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However, by using the next lemma, a deductive query can be answered in poly- 
nomial time, if a or iV(c) is small. 

Lemma 9. LetHi andY,2 he theories. For a nonnegative integer a, Thenaa(J^i) \= 
S2 if and only |= (T_q,(S2). 

Proof. For the if part, if Si \= a-a(J^2), then we have \= o"a((T_a(S2)) \= S2 

by (3). On the other hand, if aaC^i) \= S2, then we have Si |= a^ai'^ai'^i)) |= 
(7_a(S2) by (3). □ 

From Lemma 9, the deductive query for the a-interior of a theory S, i.e., 
(Ta(S) 1= c for a given clause c is equivalent to the condition that S \= a-a{c). 
Since we have a-a{c) = /\ scc-. (Vfe5^) Lemma 3, the deductive query for 

|S| = |c|-a 

the a-interior can be done by checking ('^') deductions for S. More precisely, we 
have the following lemma. 

Lemma 10. Let T, be a Horn theory, let c be a clause, and a be a nonnegative 
integer. Then a"a(S) |= c holds if and only if, for each subset S of N{c) such that 
\S\ > \N{c)\ - a, at least (a - |A^(c)| + l^] + 1) j 's in P{c) satisfy S |= Vjgs^i VXj. 

Proof. Prom Lemmas 3 and 9, crQ(S) |= c if and only if S |= /\ scc; (V^es^)- 

\S\ = \cl~a 

It is known that for a Horn theory S and clause d, S |= d if and only if S |= 
y ieN{d)'^i ^ ■^'i holds for some j E P{d) (i.e.. All the prime implicates of Horn 
theory arc Horn). This proves the lemma. □ 

This lemma implies that the deductive query can be answered by checking the 
number of j's in P(c) that satisfy S \= \l ^^s'^i ^ each S. Since we can 

check this condition in linear time and there are Ylp=o ^^f'^) ^^^h S"s, we have 
the following result, which complements Theorem 8 that the problem is intractable, 
even if P{c) = 0. 

Theorem 11. Let be a Horn theory, let c he a clause, and let a he a nonnegative 
integer. Then a deductive query cra(S) |= c can be answered O^X^p=o ('^p*^^') II ^ II 

+ |P(c)|^ time. In particular, it is polynomially solvable, if a = 0{1) or |Ar(c)| = 
0(log lis II). 

4 Deductive Inference from Characteristic Sets 

In this section, we consider the case when Horn knowledge bases can be represented 
by characteristic sets. Different from formula-based representation, the deductions 
for interiors and exteriors are both intractable, unless P=NP. 
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4.1 Interiors 



We first present an algorithm to solve the deduction problem for the interiors of 
Horn theories. The algorithm requires exponential time in general, but it is poly- 
nomial when a is small. 

Let S be a Horn theory given by its characteristic set c/ior(E), and let c be a 
clause. Then for a nonnegative integer a, we have 

o"_q(S) ^ c if and only if (T_a(S) A c = 0. (6) 

Let be a unique minimal model such that c(u*) = (i.e., c(u*) = 1). By the 
definition of interiors, v* is a model of G-a^X) if ^'^'^ o^^ly if ^ '"'s in A/'a(f*) are 
models of S. Therefore, for each model v in we check if v G mo(i(S), which 

is equivalent to 

l\ w = V. (7) 

luGchar(S) 

w'>_'v 

If (7) holds for all models v in Ma{y*\ then we can immediately conclude by (6) 
that (T_a(Il) ^ c. On the other hand, if there exists a model v in A/'a(v*) such 
that (7) does not hold, let J = ON{/\Tj,schar(i:) w) \ ON{v). By definition, we have 

J 7^ 0, and we can see that 

(7_q(I:) \= y XiWxj for all J. (8) 

ieON{v) 

If J n N{c) ^ 0, then by Lemma 3 and (8), we have cj_q,(E) |= \/i^oN{v)nN{c) 
since \ON(v) \ N{c)\ < a — 1. This implies (T_a(S) \= c. On the other hand, if 
J n N(c) = 0, then by Lemma 3 and (8), we have c7_a(S) |= View(c) ^« ^ 
j G J. Thus, if J contains an index in P(c), then we can conclude that (T_q,(S) |= c; 
Otherwise, we check the condition cj_o(E) |= c V VjeJ^' iiistcad of (t_„(S) |= c. 
Since a new clause d = c V \J j^jXj is longer than c, after at most n iterations, 
we can answer the deductive query. Formally, our algorithm can be described as 
Algorithm 2. 

Theorem 12. Given the characteristic model char{T?) of a Horn theory S, a clause 

c and a nonnegative integer a, a deductive query (t_q,(S) \= c can he answered in 
0(n""'"^|c/iar(E)|) time. In particular, it is polynomially solvable, ifa = 0{l). 

Proof. Since we can see algorithm Deduction-Interior-from-Charset cor- 
rectly answers a deductive query from the discussion before the description, we 
only estimate the running time of the algorithm. 

Steps 0, 1 and 3 require 0{n) time. Step 2 requires 0(n"+^|c/iar(S)|) time, 
since (7) can be checked in 0(n|c/iar(S)|) time. Since we have at most n iterations 
between Steps 1 and 2, the algorithm requires 0{n°'~^'^\char{T,)\) time. □ 
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Algorithm 2 Deduction-Interior-from-Charset 

Input: The characteristic set char{T,) of a Horn theory S, a clause c and a non- 
negative integer a. 

Output: Yes, if (T_q,(E) |= c; Otherwise, No. 
Step 0. Let N := N{c), d := c and q := 1. 

Step 1. Let V* be the unique minimal model such that d{v*) = 0. 

Step 2. For each v in Ma{v*) do 
If (7) does not hold, 

then let u^^) := v, J := ON{l\^echar{-s) w) \ ON{y) and 
g := g + 1 

If J n (A^ U P(c)) / 0, then output yes and halt. 
Let N := N U J and d := Vieiv^i V VieP(c) ^j- 
Go to Step 1. 
end {for} 

Step 3. Output No and halt. □ 
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However, in general, the problem is intractable, which contrasts with the formula- 
model representation. 

Theorem 13. Given the characteristic set charts) of a Horn theory S and a 
positive integer a, it is co-NP -complete to decide whether (T_a(S) is consistent, 
i.e., mod{a-a{^)) ¥^ 0- 

Proof. Let us first show the co-NP-completeness of the problem. Apply Algorithm 
Deduction-Interior-from-Charset to the instance {char{T,), c = 0, a). If 
a"_a(S) is not consistent, then the algorithm constructs vectors v^^\ . . . , v^''\ k < n, 
in Step 2. We can see that these vectors form a witness to the inconsistency of 
cr_a(E). In fact, if we are given these vectors, the inconsistency can be checked in 
polynomial time. This implies that the problem belongs to co-NP. 

We show the co-NP-hardness by reducing Independent Set to our problem. 
Given a problem instance G = {V = {1,2, . . . , n}, E) and k of Independent Set, 
let us define a Horn theory Eg over At = {xi,x-2, . . . ,Xn\ by 

char{Y.G) = | {i,j] € E,l g y \ {i, j}}, 

where ti^*'-?) and are respectively the vectors defined by OFF{v^''''^^) = {i,j} 

and OFF{v^'^'^'''^) = {i,j,l}. Let a = n — k. Note that is a negative theory, 
and hence a-aC^c) is consistent if and only if (00- --O) is a model of (7_q.(S(3). 
Moreover, the latter condition is equivalent to the one that G has no independent 
set of size at least k{= n — a). This completes the proof. □ 

This result immediately implies the following corollary. 

Corollary 14. Given the characteristic set char{T,) of a Horn theory S, a clause 
c and a positive integer a, it is NP-complete to decide whether a deductive query 
cr_Q,(E) 1= c holds, even if c = ^. □ 

Note that, different from the other hardness results, the hardness is not sensitive 
to the size of c. 

4.2 Exteriors 

Let us consider the exteriors. Similarly to the formula-based representation, we 
have the following negative result. 

Theorem 15. Given the characteristic set char{T,) of a Horn theory T,, a clause 
c and a positive integer a, it is co-NP -complete to decide if a deductive query 
(Tq.(S) \= c holds. 
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Proof. Prom Lemmas 3 and 9, crQ(S) ^ c if and only if there exists a subclause d 
of c such that \d\ = \c\ — a and S ^ cZ. This d is a witness that the problem belongs 
to co-NP. 

We then show the hardness by a reduction from Vertex Cover which is 
known to be NP-hard. Vertex Cover is the problem to decide if a given graph 
G = {V,E) has a vertex cover U such that \U\ < k for a given integer k{< n). 
Here U C V is called vertex cover if U Ci e ^ holds for all e G E. For this 
problem instance, we construct our problem instance. For each e € E, let Wg = 
{ei, 62, ... , e|y|}, and let W = IJeeE ^e- Let m^'"\ v eV,he a model over F U 
such that 

ONim^"^) = {V\ {v}) U IJ We, 

and let c/iar(S) be the characteristic set for some Horn theory S defined by 
chariTi) = {m^'"^ \ v G V}. We define c and a by 

c = \^ XiM \l Xi and a = k, 

i&v iew 

respectively. For this instance, we show that (t„(S) ^ c if and only if the corre- 
sponding G has a vertex cover U of size at most k (= a). 

For the if part, let U be such a vertex cover of G. For this U, we consider model 
jj nv-""' , which is a model of S by the intersection property of a Horn 
theory. Note that m*^^) does not satisfy a clause d = \/ i^v\jjXi V \/i^y\/Xi. Since 

d is a subclause of c of length at least |c| — a, m^^^ is not a model of a-a{c) by 
Lemma 3. This completes the if part by Lemma 9. 

For the only-if part, let us assume that crQ,(E) ^ c. Then by Lemmas 3 and 9, 
there exists a subclause d of c such that \d\ = \c\ — a and T, ^ d. This implies that 
H A d contains a model m. By a < n, for each e G E, there exist an index j in We 
such that nij = 0. Since any model m' in E satisfy either = or m- = 1 for all 
i G We, we have = for all i G W. This means that F \ ON{m) is a vertex 
cover of G, and since \V \ ON{m)\ < k, we have the only-if part. □ 

By using Lemma 10, we can see that the problem can be solved in poly- 
nomial time, if a or |A^(c)| is small. Namely, for each subset S of N(c) such 
that |5| > \N{c)\ - a, let denotes the model such that ON{v^) = S. Then 

= f\wechar(s): w Is thc uulquc minimal model of S such that ON(w^) ^ S, and 

hence it follows from Lemma 10 that it is enough to check if \ON{w^) P{c)\ > 
a - \N{c)\ + \S\ + 1. Clearly, this can be done in in O (j2p=o ('^^'^^')n|c/iar(S)|) 
time. 
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Moreover, if |P(c)| is small, then the problem also become tractable, which 
contrasts with Theorem 8. 

Lemma 16. Let T, be a Horn theory, let c be a clause, and a be a nonnegative 
integer. Then cTq;(S) |= c holds if and only if each S C P(c) such that \S\ > 
\P{c)\ — a satisfies 

\OFF{w)r\N{c)\>a-\P{c)\ + \S\ + l (9) 
for all models wofT, such that OFF{w) H P{c) = S. 

Note that (9) is monotone in the sense that, if a model w satisfies (9), then all 
models v with v < w also satisfy it. Thus it is sufficient to check if (9) holds for 
all maximal models w of T, such that OFF{w) fl P(c) = S. Since such maximal 
models w can be obtained from w^^ {i G S) with i G n P{c) C S 

by their intersection w = l\.i^gW^^\ we can answer the deduction problem in 

0(nEifJr4)|-.('?')l«^-(S)|-) time. 

Theorem 17. Given the characteristic set char{T,) of a Horn theory, a clause 

c, and a nonnegative integer a, a deductive query o"q,(S) |= c can be answered 
in o(nmm{Y,p=o {^^^'''')\char{Y.)\,Y,^^J^^^^^^_^ {^^^^'')\char{Y.)\P}^ time. In par- 
ticular, it is polynomially solvable, if a = 0{1), \P{c)\ = 0{1), or |A^(c)| = 
0(logn • |c/iar(E)|). 

5 Deductive Inference for Envelopes of the Exteriors 
of Horn Theories 

We have considered the deduction for the interiors and exteriors of Horn theories. 
As mentioned before, the interiors of Horn theories are also Horn, while this does 
not hold for the exteriors. This means that the exteriors of Horn theories might lose 
beneficial properties of Horn theories. One of the ways to overcome such a hurdle 
is Horn Approximation, that is, approximating a theory by a Horn theory [15]. 
There are several methods for approximation, but one of the most natural ones is 
to approximate a theory by its Horn envelope. For a theory S, its Horn envelope 
is the Horn theory Eg such that mod(Se) = Cl^{mod{'E)). Since Horn theories are 
closed under intersection, Horn envelope is the least Horn upper bound for E, i.e., 
chariTig) D char(Ti) and there exists no Horn theory S* such that c/iar(Ee) 2 
c/tar(E*) D char{'E). In this section, we consider the deduction for Horn envelopes 
of exteriors of Horn theories, i.e., (7Q,(E)e \= c. 
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5.1 Model-Bcised Representations 

Let us first consider the case in which knowledge bases are represented by charac- 
teristic sets. 

Proposition 18. Let be a Horn theory, and let a be a nonnegative integer. Then 
we have 

mod{aa{^)e) = Clr,{ (J No,{v)). (10) 

Proof. By definition, mod{o'a(^)e) = Cl/xijnodi^aai^y)) 2 C^f\^X}v^char{T,) 
holds. For the converse direction, let v* be a model of Horn envelope of the a- 
exterior, i.e., v* € mod{(Ja{^)e)- Then v* can be represented by v* = A^ety'^ 
some W C mod{aa{^))- Assume that w \s contained in Afa{u) for some model 
« of E. Since such a u can be represented hy u = Azes^, ^ some Su, C char{T,), 
w belongs to Cl/^{\J^^g^J\fa{v)). This, together with v* = A«;6ty'"^' implies that 
V* also belongs to ClA{\Jvechar(i:) ^a{v)). □ 

For a clause c, let v* be the unique minimal model such that c{v*) = 0. We 
recall that, for a Horn theory 

$ 1= c if and only if c( /\ v) = 1. (11) 

v>v* 

Therefore, Proposition 18 immediately implies an algorithm for the deduction for 
f7a(S)e from chariTi), since we have c/iar((Ta(S)e) C Uj;Gc/iar(s) ■^a(^)- However, 
for a general a, \Jv£char{Y.)^oi{v) is exponentially larger than chariT), and hence 
this direct method is not efficient. The following lemma helps developing a poly- 
nomial time algorithm. 

Lemma 19. Let T, be a Horn theory, let c be a clause, and let a be a nonnegative 
integer. Then aa{'S)e \= c holds if and only if the following two conditions are 
satisfied. 

(i) \OFF{v) n N{c)\ > a holds for all v G char{T.). 

(ii) If S = {v e char{T.) \ \OFF{v) n N{c)\ = a} ^ %, P{c) is not covered with 

OFF{v) for models v in S, i.e., P{c) ^ IJ OFF{v). 

\OFF(v)nN{c)\=a 

Proof. To show the if part, let us first assume that (i) and (ii) in the lemma holds. 
Let ?; be a model in char{T,) such that \OFF{v) D iV(c)| > a. Then all models w 
in Ma{v) satisfy OFF{w) n N{c) ^ 0. Therefore, if all the models v in chariT.) 



16 



satisfy \OFF{v)nN{c)\ > a, then by Proposition 18, we have OFF{w)nN{c) 7^ 
for any model w of cJa(S)e. This imphes cJa(S)e |= c. Therefore, let us consider the 
case when S = {v £ chariY,) \ \ OFF{v) n -/V(c)| = a} is not empty. Let v* be the 
unique minimal model such that c{v*) = 0. Then by Proposition 18, we have 

{v G c/iar((TQ,(S)e) | v > v*} 

C {w I ON{w) = ON{v) U N{c) for some v G S}. (12) 

Since P{c) is not covered with OFF{v) for models v in 5, this, together with (11) 
implies (jQ,(E)e ^ c. 

Let us next show the only-if part. Assume that (i) is satisfied, but (2) is not. 
Then (11) and (12) imply aa{T.)e ^ c. On the other hand, if (1) is not satisfied, 
i.e., there exists a v G char{T) such that \OFF{v) n N{c)\ < a, let w^^ , i e P(c), 
be a model in Maiv) such that ON{w^^'^) D N{c) and OFF^w^"^) D {i}, and let 
w* = AiGP(c) Then we have c{w*) = and w* G mod((TQ,(S)e) by Proposition 
18. This implies aa(S)e ^ c. □ 

The lemma immediately implies the following theorem. 

Theorem 20. Given the charaeteristic set char{T,) of a Horn theory S, a clause 
c, and a nonnegative integer a, a deductive query (Ta(E)e |= c can he answered in 
linear time. 

We remark that this contrasts with Corollary 14. Namely, if we are given the 
characteristic set char{T,) of a Horn theory S, c7Q,(S)e |= c is polynomially solvable, 
while it is co-NP-complete to decide if era (S) \= c. 

5.2 Formula-Based Representation 

Recall that a negative theory (i.e., a theory consisting of clauses with no positive 
literal) is Horn and the exteriors of negative theory are also negative, and hence 
Horn. This means that, for a negative theory S, we have c7a(S)e = c7q(S). There- 
fore, we can again make use of the reduction in the proof of Theorem 8, since the 
reduction uses negative theories. 

Theorem 21. Given a Horn theory S, a clause c, and a nonnegative integer a, it 
is co-NP-complete to decide whether aa{^)e \= c holds, even if P{c) = 0. 

Proof. Since the hardness is proved similarly to Theorem 8, we show that the 
problem belongs to co-NP. 
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Let V be a model of crQ.(S)e. Then v can be represented by v = /\yj^w'^ 
some W C cW((Ta(S)). Since cW((7a(S)) C U«,ecfear-(E) -^alf^) by Proposition 
18, we have 

. = A ( A (13) 

wechar{S) u&Syj 

for some Syj C Ma{w). We claim that there exists such a representation that 
15^1 < nholdsforaUi(;'sin(13). Letu;* = A„g5^ and let / = ON{w*)nOFF{w) 

and J = OFF{w*) n ON{w). Then we have u;* = f\jej(w - e^^) + Eie/^^'^)' 

where e^*) denotes the ith unit model. Since w — e^^^ + X^jg/S^*) G Afa{w) for all 
J € J, the claim is proved. 

Note that (Ta(i;)e ^ c if and only if there exists a model v of (TQ,(E)e such that 

c{v) = 0. Since any model v of a"a(E)e can be represented hyv = Awechar{S) (AugS™ ^ 
for some Sy, C J\fa{w) with IS^ol < n by our claim, the problem is in co-NP. □ 

However, if a or N(c) is small, the problem becomes tractable by algorithm 
Deduction-Envelope- Exterior-from-Horn-Theory (Algorithm 3). 

The algorithm is based on a necessary and sufficient condition for (To(E)e |= c, 
which is obtained from Lemma 19 by replacing all char{T,)'s with mo(i(S)'s. It is 
not difficult to sec that such a condition holds from the proof of Lemma 19. 

Theorem 22. Given a Horn theory S, a clause c, and a nonnegative integer a, a 
deductive query aa(J^)e \= c can be answered in 0(^{{^^[f) + f^^^'^)) ||S|| +|P(c)|) 
time. In particular, it is polynomially solvable, if a = 0(1) or \N{c)\ = 0(log || S ||). 

Proof. The correctness of the algorithm follows from the discussion after its de- 
scription. For the time complexity, it is known [3] that the satisfiability prob- 
lem, together with computing a unique minimal model for a Horn theory, is pos- 
sible in linear time. Since the number of the iterations of for-loops in Steps 2 
and 3 are bounded by ('^l']^') and ('^q'^'"), respectively, the algorithm requires 

0(((ISI) + ra)l|S||+|P(c)|)time. □ 
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